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RECORDING APPARATUS AND RECORDING METHOD OF 
ELECTRONIC WATERMARK 



BACKGROUND OF THE INVENTION 

5 

Field of the Invention; 

The present invention relates to a recording of contents 
information recorded with an electronic watermark signal therein, 
particularly, relates to a recording apparatus and a recording 
10 method of an electronic watermark, wherein an electronic 
watermark signal is always held when a part of contents 
information is extracted and recorded. 



15 Description of the Related A r t ; 

An electronic watermark is a technique of embedding a 
certain inforanation in a multimedia data such as image and sound 
and concealing the certain information. There provided various 
methods of concealing. 
20 The NTT Human Interface Laboratory reported "An 

Embedding Method of Copyright Information using DCT for 
Digital Moving Pictures" in the SCIS £ 97-31G. It proposes the 
method of embedding information in the MPEG (Moving Picture 
Experts Group) code, particularly, the method of embedding 
25 information based upon alteration of DCT (discrete cosine 
transform) coefficient, a motion vector and quantization 
characteristics. 

The Defense Academy of Japan reported "A Method of 
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Signing Watermark on a Picture by PN Succession" in the 
8018*97-266. It proposes the method of diffusing a picture signal 
by the PN succession and synthesizing a signature information 
with the picture in accordance with the direct diffusion method. 
5 6. Caronni proposed that a tag, which is a small geometrical 

patternXwas added to an electronically processed picture in an 
intensity \evel, which is hardly perceived visibly, is proposed in 
the thesis titled "Assuring Ownership Rights for Digital Images" 
in the Proc.\Reliable IT Systems, VIS'95, 1995. A method of 
10 embedding an electronic watermark signal, which is resemble to 
quantization noike is described in the theses "Embedding Secret 
Information into \a Dithered Multi-level Image" in the IEEE 
Military Comm. Conference, pp. 216-220, 1990 by K. Tanaka and 
"Video-steganograph^' in the IMA Intellectual Property Proc, VI, 
15 pp. 187-206, 1994 by Rl Mitsui et al. respectively. 

A method of inserting an electronic watermark signal into a 
pixel allocated in a vicinity of an outline of picture in the least 
significant brt is described in the thesis titled "Cryptology for 
Digital TV Broadcasting", Proc. of the IEEE, 83(6), pp. 944-957, 
20 1995, by Macq g^nd Quisquater. 

A statistical method called "patchwork" and a method of 
utilizing a random texture pattern, which is shown in a picture 
called "texture block coding" is explained in the thesis titled 
"Techniques for Data Hiding", Proc. of SPIE, v2420, page 40, July 
25 1995, by W. Bender et al. 

MPEG signal, which is one of compressed signals, to be 
inserted with an\electronic watermark signal is depicted next. 
Essentially MPEgV is a name of organization, "Moving Picture 
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Experts Group". However, it currently represents standards or 
specifications for coding signals. Accordingly, MPEG is composed 
of several techniques. 

Fig. 6 shows a block diagram of the MPEG encoder according 
to the prior art. 

In Fig. 6, the MPEG encoder comprises a predictor 41 for 
motion compensation, a subtracter 42, a discrete cosine 
transformer (DCT) 43, a quantizer 44, a VLC (variable length 
coder) 45, a buffer 46, an inverse-quantizer 47, an inverse-DCT 48, 
an adder 49 and a memory 50 for picture. 

\In the subtracter 42, a difference between an input picture 
signal iind a locally decoded picture, which is predicted for motion 
compensation by the predictor 41, is subtracted from the input 
picture s\gnal. Accordingly, a time redundancy portion is deleted 
form the input picture signal. There exist 3 modes of predicting 
directions: \past", "future" and "both past and future". Further, 
these modes ean be used by switching each macro block (MB) of 16 
pixels multiplied by 16 pixels. A direction of prediction is decided 
by a picture-tycpe given to the input picture signal. There is 
existed 2 modes\of "predicting from past" and "encoding an MB 
independently wiVhout predicting" in a predictive coded picture 
(P-picture). There is existed 4 modes of predicting "future", "past", 
"both past and future" and "encoding a MB independently without 
predicting" in a bi-uirectionally predictive coded picture (B- 
picture). Furthermore\ encoding all MBs independently is an 
intra-coded picture (I-pi^ture). 

A motion vector is detected with the accuracy of half pel or 
half-pixel afteir performing a pattern matching of a motion area at 
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each MB and motion compensation is predicted by shifting it with 
a motion component. There is existed 2 directions of horizontal 
and vertical in a motion vector. The direction is transmitted as an 
: additional information of MB in conjunction with a motion 

5 compensation (MC) mode, which indicates a prediction from where. 
From a first I-picture to a picture preceding a second I-picture is 
called a group of pictures (GOP). In a case that the GOP is used in 
storage media such as an optical recording medium and a magnetic 
recording medium, approximately 15 pictures are used in general. 
10 A differential picture is orthogonally transformed in the DCT 

□ 43. According to MPEG, the 2-dimentional DCT is applied to a 

as. 

IH DCT block of 8x8 with dividing one MB into 4. Generally, a video 

•J signal contains more low frequency components and less high 

CR frequency components, so that DCT coefficients converge into low 

15 frequency components if the DCT is applied, 
iin The picture data (DCT coefficient) applied by the DCT is 

Q quantized by the quantizer 44. 

O The quantized data is processed with the variable length 

coding (VLC) by the VLC 45. 
20 The data coded by VLC is temporarily stored in the buffer 46 

and outputted as a coded data in a predetermined transfer rate. A 
generated coding amount per MB of the data to be outputted is 
transferred to a code amount limiter not shown. The code amount 
limiter controls a quantizing scale by feeding an error code 
25 amount, which is a difference between the generated code amount 
and a target code amount, back to the quantizer 44 for controlling 
the generated code amount. 

Further, the quantized picture data is inversely quantized by 
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the inverse-quantizer 47 and inversely discrete cosine 
transformed by the inverse-DCT 48 and temporarily stored in the 
memory 50 through the adder 49, and then the quantized picture 
data is used in the predictor 41 for motion compensation as 
5 reference of a decoding picture or a local decoding picture so as to 
calculate a differential picture. 

The coded data outputted from the buffer 46 is decoded 
through an inverse process of coding. 

Fig. 7 shows a block diagram of the MPEG decoder according 
10 to the prior art. 

In Fig. 7, the MPEG decoder comprises a variable length decoder 
(VLD) 51, an inverse-quantizer 52, an inverse-DCT 53, an adder 
54, a memory 55 for a picture and a predictor 56 for motion 
compensation. 

15 yWith respect to an insertion frequency of electronic 

watermark signals in the prior art mentioned above, it almost 
depends\upon an application. For example, in a case of picture 
data, electronic watermark signals are scattered by using several 
frames of pictures with depending upon a method of electronic 
20 watermark. \ln this case, it shall be a configuration of combining 
several frames. Otherwise there is existed a problem that an 
electronic watermark signal can not be read out. Further, a case 
that an electronic watermark signal is recorded in one frame at 
each several frames can be considered. In this case, there is 
25 existed another problem that an electronic watermark signal may 
disappear from a Frame recorded with an electronic watermark 
signal if a frame notVrecorded with an electronic watermark signal 
is extracted. \ 
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An electronic watermark signal is not always recorded in a 
data, which is extracted from a specific area in a frame, even 
though an electronic watermark signal is recorded in each frame. 
Furthermore, in a case of audio data, there is existed a case 
5 that electronic watermark signals are scattered in the audio data 
by usingV specific number of samples. In this case, it shall be a 
configuration of combining the specific number of samples. 
Otherwise further problem that an electronic watermark signal 
can not be read out occurs. 



SUMMARY OF THE INVENTION 

Accordingly, in consideration of the above-mentioned 
5 problenrs of the prior art, an object of the present invention is to 
provide av recording apparatus and a recording method of an 
electronic watermark, which can hold an electronic watermark 
signal of which content is always equivalent to a first electronic 
watermark signal while extracting a contents data of a less 
0 amount of information than a predetermined unit of information 
from an original Contents data, wherein the original contents data 
is recorded with trie first electronic watermark signal by each or 
throughout the predetermined unit of information. 

In order to achieve the above object, the present invention 
provides, according to an aspect thereof, a recording apparatus of 
an electronic watermark comprising a detecting device for 
detecting a first electronic watermark signal from an original 
contents data inputted, a memory device for storing the first 
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electronic watermark signal detected by the detecting device 
temporarily, an extracting device for extracting a part of contents 
data from the original contents data and an inserting device for 
recording a second electronic watermark signal of which content is 
equivalent to that of the first electronic watermark signal 
detected by the detecting device in the contents data extracted by 
the extracting device. 

lAccording to another aspect of the present invention, there 
provided a recording method of an electronic watermark 
comprising a step of detecting a first electronic watermark signal 
from an original contents data inputted, a step of storing the first 
electronic watermark signal detected in the step of detecting 
temporarily, a step of extracting a part of contents data from the 
original consents data and a step of inserting a second electronic 
watermark signal of which content is equivalent to that of the first 
electronic waAermark signal in the contents data extracted in the 
step of extract^ig. 

Oth&r object and further features of the present invention 
will be apparent from the following detailed description when read 
in conjunction with the accompanying drawings. 



BRIEF DESCRIPTION OF DRAWINGS 

Fig. 1 shows a block diagram of a recording apparatus of an 
electronic watermark according to a first embodiment of the 
present invention. 

Fig. 2 shows a block diagram of a recording apparatus of an 
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electronic watermark according to a second embodiment of the 
present invention. 

Fig. 3 shows a block diagram of an encoding section in a 
recording apparatus of an electronic watermark according to a 
third embodiment of the present invention. 

Fig. 4 shows a block diagram of a decoding section in a 
recording apparatus of an electronic watermark according to the 
third embodiment of the present invention. 

Fig. 5 shows a block diagram of a decoding section in a 
recording apparatus of an electronic watermark according to a 
fourth embodiment of the present invention. 

Fig. 6 shows a block diagram of the MPEG encoder according 
to the prior art. 

Fig. 7 shows a block diagram of the MPEG decoder according 
to the prior art. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

-{F irst Eitt inrd i m e^ ]- 

Fig. 1 shows a block diagram of a recording apparatus of an 
electronic watermark according to a first embodiment of the 
present invention. 

In Fig. 1, a recording apparatus comprises a detector 1 of 
signal, a memory 2 for electronic watermark contents, an 
extractor 3 of contents signal and an inserter 4 of electronic 
watermark. 

A contents information is inputted into the detector 1 and an 
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electronic watermark (first electronic watermark) signal is 
detected from the inputted contents information in the detector 1. 
The detected electronic watermark signal is temporarily stored in 
the memory 2. The inputted contents information is transmitted to 
the extractor 3 thereafter. In the extractor 3, a part of contents 
signal is extracted from an original contents signal. In a case of a 
picture signal, for example, a specific frame signal is extracted 
from an original picture signal. In a case of an audio signal, a 
specific part of audio signal is extracted from an original audio 
signal. 

The electronic watermark signal temporarily stored in the 
memory 2 is transmitted to the inserter 4. In the inserter 4, an 
electronic watermark (second electronic watermark) signal of 
which content is equal to that of the detected electronic 
watermark (first electronic watermark) signal is additionally 
recorded in the contents signal extracted by the extractor 3. 

'In a case that a contents signal is a picture data, an 
electronic watermark signal is scattered in several frames by 
using som\ frames of picture by an electronic watermark system 
as mentionecl above, that is, an electronic watermark signal is 
recorded over sWe frames of picture. In this case, the picture data 
shall be a configuration of combining several frames. Otherwise 
the electronic watermark signal can not be read out. Further, 
another case can be Considered that an electronic watermark is 
recorded in one frame Vt each several frames. In this case, if a 
frame signal not recorded with an electronic watermark signal is 
extracted, the frame signVl disappears from the picture data, 
which is extracted by the electronic watermark signal, as a matter 
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of fact. Furthermore, an electronic watermark signal is not always 
recorded in a data, which is extracted from a specific area in a 
frame, even though an electronic watermark signal is recorded at 
each frame. Moreover, in a case of audio data, an electronic 
watermark signal is scattered by using a specific number of 
samples as a same manner as the case of picture data. In this case, 
the audio data shall be a configuration of combining the specific 
number of samples. Otherwise the electronic watermark signal 
can not be read out. 

Isn order to solve these problems, the inserter 1 shown in Fig. 
1 records a new electronic watermark signal (second electronic 
watermark signal) of which content is equivalent to that of an 
originally recorded electronic watermark signal (first electronic 
watermark signal) by using a method of a less data amount of 
15 contents data necessary for inserting an electronic watermark or a 
less sampling number than that of the originally recorded 
electronic watermaVk (first electronic watermark) signal. 

As an actual example, an original electronic watermark 
signal is scattered into 15 frames and the electronic watermark 
20 signal is recorded in a low signal level in consideration of 
deterioration of picture quality. When detecting such an electronic 
watermark signal, electronic signals of 15 frames are integrated 
and the integrated electronic signal is detected with increasing a 
signal to noise ratio (S/N) of the signal level. In a case that only 
25 one frame of signal is extracted from a picture data recorded with 
an electronic watermark signal being scattered throughout 15 
frames and recorded, an electronic watermark information 
recorded in the frame can not be detected. Accordingly, the 
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original electronic watermark signal is previously stored in the 
memory 2 and a new electronic watermark signal of which content 
is equal to that of the original electronic watermark signal is 
produced, and then the new electronic watermark signal is 
recorded in the extracted one frame of the picture data with a 
higher signal level. 

^S ^ Kio nd Embudime -ffrfcj 1 

Fig. 2 shows a block diagram of a recording apparatus of an 
electronic watermark according to a second embodiment of the 
present invention. 

m Fig. 2, a recording apparatus of an electronic watermark 
comprises a detector 1 of signal, a memory 2 for electronic 
watermarkycontents, an extractor 3 of contents signal, an inserter 
4 of electronic watermark, a decider 5 for judging whether or not 
an electronic Watermark signal is existed and a switch 6. 

A contents information is inputted into the detector 1 and an 
electronic watermark (first electronic watermark) signal is 
detected from the inputted contents information in the detector 1. 
The detected electronic watermark signal is temporarily stored in 
the memory 2. The inputted contents information is transmitted to 
the extractor 3 thereafter. In the extractor 3, a part of a contents 
signal is extracted from an original contents signal. 

The electronic watermark signal temporarily stored in the 
memory 2 is transmitted to the inserter 4. 

The contents signal extracted by the extractor 3 is judged by 
the decider 5 whether or not an electronic watermark signal is 
recorded. A result of judgement is transferred to the switch 6. In a 
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case that the extracted contents signal is judged as being recorded 
with an electronic watermark signal, the switch 6 is connected to 
the decider 5 and the contents signal extracted by the extractor 3 
is outputted as it is. 

In a case that the extracted contents signal is judged as not 
being recorded with an electronic watermark signal, the switch 6 
is connected to the inserter 4 and the contents signal recorded by 
the inserter 4 with the new electronic watermark signal (second 
electronic watermark signal) of which content is equal to that of 
the first electronic watermark signal is outputted through the 
switch 6. 

In the second embodiment, it is assumed that a contents data 
is a picture data and the picture data is recorded with a first 
electronic watermark signal at each predetermined number of 
pictures or throughout the predetermined number of pictures. In a 
case that a picture data of less number of pictures than the 
predetermined number of pictures is extracted from an original 
picture data, a second electronic watermark signal of which 
content is equivalent to that of the first electronic watermark can 
be recorded in the extracted picture data in a less number of 
pictures than the predetermined number of pictures. 

In a case that a picture data of a smaller area than a 
predetermined area is extracted from an original picture data 
recorded with a first electronic watermark signal in each 
predetermined area or throughout the predetermined area, a 
second electronic watermark signal of which content is equivalent 
to that of the first electronic watermark signal can be recorded in 
the extracted picture data in the smaller area than the 
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predetermined area. 

Further, in a case that a contents data is an audio data and 
an audio data of a less number of samples than a predetermined 
number of samples is extracted from an original audio data 
recorded with a first electronic watermark signal in each 
predetermined number of samples or throughout the 
predetermined number of samples, a second electronic watermark 
signal of which content is equivalent to that of the first electronic 
watermark signal can be recorded in the extracted audio data, 
wherein the second electronic watermark is recordable in a less 
number of samples than the predetermined number of samples. 

Furthermore, with assuming that a contents data is other 
data than picture such as a letter and an audio data, in a case that 
a contents data of a less number of samples than a predetermined 
number of samples is extracted from an original contents data 
recorded with a first electronic watermark signal in each 
predetermined number of samples or throughout the 
predetermined number of samples, a second electronic watermark 
signal of which content is equivalent to that of the first electronic 
watermark signal can be recorded in the extracted contents data 
in a less number of samples than that the predetermined number 
of samples. 

-pF hii ' d ' EnibudimmiL] 

This embodiment is an application of adopting the MPEG 
encoder shown in Fig. 6 and the MPEG decoder shown in Fig. 7 in 
a recording apparatus of an electronic watermark. 

Fig. 3 shows a block diagram of an encoding section in a 
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recording apparatus of an electronic watermark according to a 
third embodiment of the present invention. 

Fig. 4 shows a block diagram of a decoding section in a 
recording apparatus of an electronic watermark according to the 
third embodiment of the present invention. 

In Fig. 3, an encoding section of a recording apparatus of an 
electronic watermark comprises an inserter 11 of an electronic 
watermark signal and an MPEG encoder 12. As shown in Fig. 3, 
the inserter 11 receives an intra-coded picture (intra-picture) 
location signal from the MPEG encoder 12 and records an 
electronic watermark signal if an inputted contents information is 
an intra-picture. Essentially, an intra-picture is distributed with 
a maximum amount of codes and is coded in picture quality of a 
highest S/N. Accordingly, it is considered that strong tolerance to 
an electronic watermark signal, which is hardly disappeared by a 
compression encoding. Finally, a compressed contents information 
is outputted from the MPEG decoder 12. 

In Fig. 4, a decoding section of the recording apparatus of an 
electronic watermark comprises an MPEG decoder 13, a detector 1 
f signalAa memory 2 for electronic watermark contents, an 
extractor 3\of contents signal, an inserter 4 of electronic 
watermark, axlecider 5 for judging whether or not an electronic 
watermark signal is existed and a switch 6. 

As shown in Fig. 4, a contents information compressed by the 
encoding section shown in Fig. 3 is transmitted to the MPEG 
decoder 13 and decoded through the MPEG decoding process, and 
then the compressed contents information becomes an input 
contents information and transmitted to the detector 1. An 
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electronic watermark signal is detected from the input contents 
information by the detector 1, in other words, an electronic 
watermark signal recorded in an intra-picture is detected. The 
detected electronic watermark signal (first electronic watermark 
5 signal) is temporarily stored in the memory 2. The input contents 
information is transmitted to the extractor 3 thereafter. A part of 
a contents signal is extracted from an original contents signal in 
the extractor 3. 

On the other hand, the electronic watermark signal stored 

10 temporarily in the memory 2 is transmitted to the inserter 4. 

The contents signal extracted from the input contents 
information by the extractor 3 is judged by the decider 5 whether 
or not an electronic watermark signal is recorded. A result of 
judgement is transmitted to the switch. In a case that an 

15 electronic watermark signal is recorded, the switch 6 is connected 
to the decider 5 and the contents signal extracted by the extractor 
3 is outputted as it is. 

In a case that an electronic watermark signal is not recorded, 
the switch 6 is connected to the inserter 4. A contents signal 

20 recorded by the inserter 4 with a new electronic watermark signal 
(second electronic watermark signal) of which content is equal to 
that of a first electronic watermark signal is outputted through 
the switch 6. 

25 ^ Fourth Embodiment] 

Fig. 5 shows a block diagram of a decoding section in a 
recording apparatus of an electronic watermark according to a 
fourth embodiment of the present invention. 
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A recording apparatus in this embodiment utilizes a signal, 
which indicates an intra-picture outputted from an MPEG 
encoder. 

In Fig. 5, a recording apparatus of an electronic watermark 
5 comprises an MPEG decoder 13, a detector 1 of signal, a memory 2 
for electronic watermark contents, an extractor 3 of contents 
signal, an inserter 4 of electronic watermark, a decider 14 for 
judging a picture type and a switch 16. 

As shown in Fig. 5, a contents information compressed by the 
10 encoding section shown in Fig. 3 is transmitted to the MPEG 
i decoder 13. The MPEG decoder 13 transmits a picture-type 

LJ information contained in the inputted compressed contents 

]f information, which is a picture signal of compression encoded by 

i; the MPEG system, to the decider 14. A contents signal extracted 

15 by the extractor 3 is judged by the decider 14 whether or not the 
contents signal is an intra-picture on a basis of the picture-type 
3 information. A result of judgment is transmitted to the switch 16. 

□ In a case that it is judged as an intra-picture, the switch 16 is 

connected to the decider 14. The contents signal extracted by the 
20 extractor 3, that is, a picture signal being inserted with an 
electronic watermark signal and judged as an intra-picture is 
outputted as it is. 

In a case that it is judged as not an intra-picture, the switch 
16 is connected to the inserter 4. In the inserter 4, a new 
25 electronic watermark signal (second electronic watermark signal) 
of which content is equivalent to that of a first electronic 
watermark signal supplied by the memory 2 is recorded in the 
extracted contents signal, that is, a picture signal of not being an 
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intra-picture. The contents signal recorded with the second 
electronic watermark signal is outputted through the switch 16. 
The other blocks shown in Fig. 5, which are not depicted in this 
embodiment, are the same functions as those of the third 
embodiment shown in Fig. 4. 

\The third and fourth embodiments shown in Figs. 3 through 
5 disclose that an electronic watermark signal is recorded in an 
intra-prcture by using a characteristic of an intra-picture of which 
picture qViality is most improved while the MPEG compression. In 
a case of extracting other picture data than an intra-picture when 
decoding, a\ new electronic watermark signal of which content is 
equivalent tV> that of an electronic watermark signal originally 
recorded in the intra-picture is recorded in the picture data to be 
extracted. Accordingly, an electronic watermark signal can be 
recorded efficiently and contents of the electronic watermark 
signal can be held even though data of a specific part of a contents 
information, which is compression encoded by the MPEG system, 
is extracted. \ 

As mentioned above, according to the present invention, an 
electronic watermark signal of which content is equivalent to that 
of a first electronic watermark signal can always be held in an 
extracted contents data, while extracting the contents data of less 
amount of information than a predetermined unit of information 
from an original contents data recorded with the first electronic 
watermark signal in each predetermined unit of information or 
throughout the predetermined unit of information. 
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